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ABSTRACT 


This  report  describes  the  developiaent  and  evaluation  of 
a  forward  air  controller  (FAC)  and  tactical  strike  pilot  (TAC) 
trainer.  The  trainer  was  designed  to  permit  a  FAC  and  a  TAC 
to  practice  the  tasks  of  communicating  the  location  of  targets. 
A  previous  analysis  of  communications  between  FAC  and  TAC 
personnel  during  actual  combat  had  revealed  that  the  task  of 
verbalizing  imagery  (describing  what  one  is  seeing)  was 
especially  difficult  and  important  to  the  success  of  the  FAC/ 
TAC  mission.  Subjects  for  the  evaluation  consisted  of  35  Air 
Force  pilots  selected  to  be  trained  as  forward  air  controllers 
at  Hurlburt  Field,  Florida.  The  subjects  were  divided  into 
2  groups:  Group  A  (N=18)  received  a  one-hour  pretest,  two 
hours  of  supervised  practice,  and  then  a  one-hour  posttest, 
Group  B  (N=17)  received  only  a  one-hour  pretest  and  a  one-hour 
posttest.  The  achievement  in  gain  of  Group  A  was  significantly 
greater  than  that  of  Group  B.  The  results  of  a  student 
questionnaire  indicated  that  the  FAC  students  enthusiastically 
endorsed  the  use  of  the  trainer  in  teaching  communication  of 
target  locations.  The  results  of  transfer  of  training  were 
inconclusive.  These  results  about  transfer  are  not  surprising 
because  performance  in  the  aircraft  was  evaluated  using  a 
subjective  and  rather  gross  scale. 


SUMMARY  AND  CONCLUSIONS 


PRO  .  :.  .5M 

An  analysis  of  combat  recordings  showed  the  frequency 
and  duration  of  the  items  that  the  forward  air  controller 
(FAC)  ..nd  the  tactical  fighter  pilot  (TAC)  mutually  discuss. 
The  problem  of  verbalizing  imagery  (describing  to  another 
person  what  one  is  seeing)  was  revealed  as  a  critical  FAC/TAC 
task  that  appears  to  depend  extensively  on  subjective  skills 
such  as  choosing  and  relating  landmarks.  The  problem  was  to 
oovise  a  relatively  simple,  yet  effective,  means  for  training 
.  A<"  personnel  in  this  important  skill. 
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A  FAC/TAC  trainer  was  developed  primarily  to  provide 
practice  in  voice  communications  of  target  locations.  To 
evaluate  the  trainer,  a  total  of  35  Air  Force  FAC  students 
used  it  to  practice  communicating  location  of  targets.  The 
students  were  divided  into  2  groups:  Group  A  (N*18)  and 
Group  B  (N=17).  Group  A  students  received  a  one-hour  pretest, 
two  hours  of  supervised  practice,  and  then  a  one-hour  posttest 
on  the  trainer.  Group  B  received  only  a  one -hour  pretest  and 
one-hour  posttest.  The  students’  average  total  flying  time 
was  651  hours.  None  of  the  students  previously  had  received 
specific  training  in  communicating  target  locations.  The  program 
consisted  of  3  phases:  (1)  pretest,  (2)  supervised  practice 
sessions,  and  (3)  posttest  Group  B  did  not  participate  in 
the  supervised  practice  session.  Group  A  and  Group  B  subjects 
were  pretested  and  posttested  on  an  individual  basis.  However, 

2  students  operated  the  trainer  during  each  2 -hour  practice 
session,  '’'hey  alternated  roles  as  FAC  fc  1  hour  and  as  strike 
pilot  for  1  hour. 

RESULTS 

Ratio  gain  scores  were  calculated  for  each  subject  for 
the  pretest  and  posttest.  The  gain  of  Group  A  was  significantly 
greater  than  that  of  Group  B  (Mann-Whitney  U  :  Z=2,475»  proba¬ 
bility  was  greater  than  .05).  A  questionnaire  designed  to 
measure  the  attitude  toward  the  trainer  was  administered  to 
the  students.  A  "general  satisfaction"  or  "favorable  attitude" 
score  was  obtained  for  each  group.  In  general,  the  students 
enthusiastically  endorsed  the  use  of  the  trainer  to  provide 
skills  in  communicating  target  locations  to  strike  pilots.  Of  the 
35  students  responses,  only  3  indicated  negative  attitudes 
toward  the  trainer.  Although  transfer  of  training  from  trainer 
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to  aircraft  was  not  originally  included  in  the  experimental 
design  because  of  the  stringent  training  schedule,  arrangements 
were  made  during  the  test  to  obtain  flight  instructor  appraisals 
on  some  subject  CN“8  for  each  group).  Although  the  mean  scores 
slightly  favored  Group  A  students,  the  differences  between 
means  of  the  2  groups  were  not  significant. 

CONCLUSIONS 

The  trainer  uar.  be  used  to  teach  communication  of  target 
location  which  seems  to  require  an  unusual  amotmt  of  subjective 
judgment  or  experience  on  the  part  of  the  FAC  student.  This 
low  cost  device  also  could  be  used  for  remedial  instruction 
in  target  detection,  recognition,  and  identification.  It  is 
presumed  that  the  use  of  motion  picture  imagery  in  the  trainer 
would  provide  real-time  training  of  even  greater  benefit. 

It  is  emphasized  that  the  trainer  is  a  part-task  trainer. 

It  was  designed  to  increase  the  ability  of  the  slow,  low-flying 
FAC  in  transferring  target  location  information.  The  trainer 
was  not  designed  to  address  all  aspects  of  the  FAC/TAC  operation. 
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Section  I 


INTRODUCTION 


PURPOSE 

This  report  describes  the  development  and  evaluation  of 
a  part- task  trainer.  The  trainer  was  designed  to  help  the 
airborne  forward  air  controller  (FAC)  to  become  more  pro¬ 
ficient  in  communicating  target  locations  to  the  faster, 
higher  flying  tactical  strike  pilot  (hereafter  reft-^red  to  as 
the  TAC) . 

PROBLEM 

In  limited  war/counterinsurgency  operations,  the  FAC 
and  TAC  engage  in  airstrikes  in  (1)  close  support  of  ground 
forces  and  (2)  those  not  in  support  of  ground  force  activities. 
Also,  the  FAC  performs  visual  reconnaissance  missions  which 
do  not  include  airstrikes.  During  strike  operations  *  pilots 
of  tactical  aircraft  are  directed  by  FAC  pilots  who  operate 
relatively  slow,  low-flying  aircraft  such  as  the  0-2  and 
OV-10  (Figure  1).  Because  of  the  difference  in  altitude, 
speed,  and  spatial  orientation  of  the  two  viewers,  this  often 
is  a  difficult  task. 

ROLE  OF  THE  FORWARD  AIR  CONTROLLER 

The  role  of  the  forward  air  controller  has  evolved  in 
both  conQ)lexity  and  responsibility  over  the  past  50  years. 

The  first  record  of  a  FAC  directing  aircraft  supporting  ground 
forces  occurred  shortly  after  World  War  I.  At  that  time, 
panels  were  placed  on  the  ground  to  indicate  the  distance  and 
direction  of  the  target  from  the  friendly  position.  In  the 
beginning  of  World  War  II,  the  Germans  improved  on  this 
technique  by  assigning  FACs  to  Panzer  units  as  these  armored 
units  moved  across  Western  Europe.  The  controllers  communicated 
by  radio  with  Stuka  aircraft  which  flew  overhead  on  alert  in 
support  of  the  armored  columns.  Also,  during  World  War  II, 

FACs  were  assigned  to  assist  United  States  ground  commanders 
in  the  use  and  control  of  tactical  air  support.  They  had  radio 
equipment  mounted  on  jeeps  which  permitted  their  control  of 
attack  aircraft. 
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B.  North  American  OV-10 


Figure  1.  Low  Altitude  Aircraft  Used  by  FACs 
to  Guide  Fighters  to  Targets  in  Southeast  Asia 
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During  the  latter  part  of  World  War  II,  employment  of 
USAF  airborne  FACs  was  initiated.  These  controllers,  flying 
L-5  Stenson  aircraft,  were  used  to  direct  artillery,  perform 
visual  reconnaissance,  and  direct  air  strikes.  Although  not 
specifically  trained  in  the  air  control  mission,  they  demon¬ 
strated  the  flexibility  and  improved  visibility  of  the  air¬ 
borne  FAC. 

During  the  Korean  War,  further  use  was  made  of  airborne 
FACs.  These  FACs,  called  "mosquitoes"  were  employed  to  direct 
strikes  in  support  of  the  ground  situations  and  target  des¬ 
criptions  improved  the  effectiveness  of  tactical  air  support. 
(Reference  1).  The  general  procedures  and  techniques  developed 
then' have  been  used  in  Vietnam  with  corresponding  effect. 

The  duties  of  a  FAC  are  varied  and  his  responsibilities 
are, greater  than  might  be  expected  of  a  junior  grade  officer. 

These  duties  include  more  than  just  controlling  a  close  air 
support  strike.  He  advises  the  ground  commander  on  the  use 
of  all  the  support  a  tactical  Air  Force  can  provide  and  he 
assists  in  planning  for  this  support. 

Our  primary  concern  in  this  study  is  the  control  of  a 
close  air  support  mission  and  the  verbal  communication  that 
must  take  place  between  the  strike  leader  and  the  FAC.  The 
strike  lead  pilot  contacts  the  FAC  on  a  preselected  radio 
channel  and  gives  him  essential  information  such  as  number 
and  type  of  aircraft,  amount  of  ordnance,  time  he  can  remain 
in  the  area,  and  othei  information  that  may  be  unique  to  that 
flight.  When  the  FAC  receives  this  information,  he  gives  the 
fighter  a  briefing  on  the  target,  terrain,  weather,  and  parti¬ 
cularly  the  ground  situation.  This  briefing  may  be  given  as 
the  fighters  are  directed  into  the  area  or  as  they  hold  over 
an  orbit  or  control  point.  Next  follows  one  of  the  most  difficult 
aspects  of  a  FAC’s  duties.  He  must  make  sure  the  strike  leader 
sees  the  target  or  target  area.  Many  te''hniques  can  be  used 
fo  achieve  this  objective.  The  easiest  way  is  to  mark  the 
target  from  an  airborne  platform.  Normally,  the  fighter  air¬ 
craft  will  have  the  FAC  in  sight  and  watch  him  roll  in  to 
fire  a  rocket  which  will  mark  the  target.  However,  many 
circumstances  might  preclude  the  FAC  from  marking  and  he  must 
verbally  describe  the  target.  Some  of  these  circumstances 
might'  be  heavy  ground  fire,  the  desire  for  complete  surprise, 
or  the  FAC  has  no  marking  rounds  left.  When  the  fighter  air¬ 
craft  has  the  target  area  in  sight,  the  control  of  the  strike 
is  very  simple.  The  FAC  needs  only  to  clear  each  fighter  as 
it  attacks  the  target  (Reference  2) . 
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Unlike  conventional  warfare,  limited  war/counterinsurgency 
activities  are  not  based  on  well-defined  battle  lines  and 
tactics.  Although  the  targets  cues  very  often  are  subtle,  the 
FAC,  nevertheless,  must  detect,  recognize,  and  identify  the 
elusive  enemy.  To  accomplish  this,  he  should  develop  a  memory 
image  of  his  area  of  responsibility  vdiich  then  becomes  a  frame 
of  reference  for  evaluating  real-time  perceptions  (Reference  5) . 
Thus,  the  FAC  can  compare  presently  available  environmental 
cues  with  the  memory  image  in  an  effort  to  detect,  recognize, 
and  identify  a  target  of  opportunity.  However,  when  the  FAC 
identifies  a  target,  he  must  be  able  to  communicate  its  location 
to  the  higher  flying  TAC.  The  trainer  developed  for  this  study 
was  designed  to  provide  practice  in  target  location  communi¬ 
cations  to  improve  FAC/TAC  operations. 


SECTION  II 


THE  FAC/TAC  TRAINER 


TRAINER  DESIGN  CONSIDERATIONS 

Although  the  task  requirements  for  communication  of 
target  locations  could  not  be  determined  by  conventional  task 
analysis,  an  alternate  approach  was  used.  Computer-based 
data  on  Southeast  Asia  combat  recordings  of  communications 
between  FACs  and  TACs  were  used  to  obtain  training  requirements. 

A  total  of  20  combat  missions  was  analyzed.  The  data  obtained 
for  the  requirements  were  based  on  5,283  FAC  and  TAC  comments. 

The  results  suggested  what  the  trainer  should  reproduce.  The 
analysis  indicated  that  53.71  of  the  FAC's  communication  task 
was  concerned  with  verbalizing  the  location  of  targets,  air¬ 
craft,  people,  and  guns  (Reference  4). 

In  addition  to  fulfilling  its  training  mission,  major 
considerations  in  the  design  of  the  trainer  were  that  it  must 
be  economical,  easily  assembled,  and  transportable  (Figures 
2,  3,  and  4).  Emphasis  was  placed  on  psychological  simulation 
as  opposed  to  engineering  simulation.  The  reason  is  that  as 
the  degree  of  engineering  simulation  increases,  the  costs  rise 
at  an  increasing  rate.  All  too  often,  the  increased  costs  do 
not  produce  commensurate  increases  in  training  value .  Psy¬ 
chological  simulation,  or  simulating  those  aspects  of  tasks 
that  will  produce  high  transfer  to  operational  performance, 
requires  thorough  attention  to  the  objectives  of  any  given 
trainer.  Without  such  attention,  there  may  be  a  tendency  to 
add  unnecessary  hardware  or  frills  (at  greatly  increased  costs) 
to  a  trainer.  This  caution  was  especially  pertinent  to  the 
design  of  the  present  trainer  because  its  purpose  was  that 
which  could  be  fulfilled  by  a  part-task  trainer. 

TRAINERS  VERSUS  OPERATIONAL  EQUIPMENT 

Frequently,  operational  equipment  is  considered  to  be  the 
most  effective  and  valid  training  equipment.  However,  this  is 
not  true  in  every  instance.  In  fact,  sometimes  it  may  be  un¬ 
desirable  to  use  real  equipment  for  training  if  suitable  trainers 
are  available  for  the  purpose.  For  example,  operational  training 
and  testing  have  several  disadvantages  which  include  (1)  high 
equipment  costs,  (2)  limitation  on  practice  of  varied  aspects 
of  tasks,  and  (3)  safety  hazards.  Practical  decisions  in  the  use 
of  training  devices  depend  upon  compromises  between  economic 
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Figure  2.  Assembly  of  FAC/TAC  Trainer  Student  Booth 


Figure  3.  The  Transportable 
Case  Opened  to 
Show  Trainer 
Components 


and  training  objectives.  A  trainer  need. not  d^|f§ate' 
operational  equipment  to  have  training  value.  Hdl^ver,  a 
positive  attitude  toward  the  trainer  on  the  part  of  the 
instructor  is  essential.  The  instructor  should  promote  favorable 
attitudes  on  the  part  of  the  student  toward  the  training  he 
receives.  If  the  student  develops  unfavorable  attitudes  toward 
the  instruction  and  trainer,  the  attitudes  may  interfere  with 
the  acquisition  of  desired  skills.  A  capable  instructor  can 
provide  the  student  with  supplementary  information  which  will 
increase  the  effectiveness  of  a  trainer  even  when  it  has  only 
minimal  cues. 


TRAINER  DESCRIPTION  AND  OPERATION 

The  trainer  includes  positions  for  the  FAC,  TAC,  and 
instructor.  It  is  constructed  of  lightweight  aluminum  tubing 
and  rear  projection  screens.  Other  equipment  includes  a 
cassette  tape  recorder,  two  35mm  slide  projectors,  an  audio 
amplifier,  headsets,  and  a  set  of  35mm  slides.  Also,  the 
3  participants  in  the  training  session  CFAC,  TAC,  and  in¬ 
structor)  share  an  intercommunication  (intercom)  system  and 
all  communications  may  be  tape-recorded  by  the  instructor 
(Figures  5,  6,  and  7).  Playback  of  the  recordings  provides 
immediate  feedback  for  the  student  as  to  the  effectiveness  of 
his  description  of  target  locations  (Reference  5) . 

The  target  area,  depicted  on  slides,  is  projected  on  the 
back  of  the  FAC’s  and  TAC’s  screens.  The  instructor  uses  a 
pointer,  or  a  penlight,  to  indicate  on  the  back  of  the  FAC's 
screen  the  target  to  be  described  by  the  FAC  to  the  TAC. 

The  instructor  turns  on  the  tape  recorder.  The  FAC  then  est¬ 
ablishes  contact  with  the  TAC  and  begins  transmitting  target 
information  to  him.  A  sample  tape  recording  of  a  FAC/TAC 
communication  scenario  is  included  with  the  trainer  for 
demonstration  purposes. 

When  power  is  on,  both  students  and  the  instructor  can 
speak  to  and  hear  each  other  through  the  headsets.  If  a 
student  wishes  to  speak  privately  with  the  instructor,  he 
presses  his  push  button  which  lights  the  respective  red  light 
on  the  intercom  set.  The  instructor  pulls  the  toggle  switch 
corresponding  to  that  student  and  a  two-way  conversation  is 
possible.  When  the  toggle  switch  is  released,  three-way 
communications  are  reinstated. 
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Figure  5.  FAC/TAC  Trainer  (Student  Posit 


Figure  6.  FAC/TAC  Trainer  (Instructor  Pos 
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Figure  7.  The  Intercommunication  Set 


SECTION  III 


METHOD 


TRAINER  TEST  IMAGERY 

Photographic  imagery  which  compensates  for  differences  in 
FAC  and  TAC  altitudes  was  used  in  the  test.  The  altitudes  as 
represented  in  the  3Smm  slides  are  2,000  feet  for  the  FAC‘s 
screen  and  8,000  feet  for  the  TAC's  screen.  Each  scene  tor 
both  FAC  and  TAC  was  photographed  from  (1)  east,  (2)  north, 

(3)  west  and  (4)  south.  The  scenes  were  photographed  in  color 
from  a  Cessna  172  aircraft  at  8,000  feet  altitude.  Two  cameras, 
mounted  side-by“-side,  were  used  to  obtain  the  imagery.  One 
camera,  equipped  with  SOmm  lens  was  used  to  photograph  the 
TAC  imagery  (8,000  feet).  Another  camera,  equipped  with  200mm 
lens,  was  used  to  photograph  the  FAC  imagery  (2,000  feet, 
simulated).  Both  camera  were  operated  simultaneously  in 
photographing  each  scene.  A  sample  of  the  imagery  in  black 
and  white  is  shown  in  Figure  8. 

SUBJECTS 

A  total  of  35  Air  Force  pilots,  selected  to  be  trained  as 
airborne  forward  air  controllers,  participated  in  the  compari¬ 
son  study.  The  students  were  divided  into  2  groups:  Group  A 
(N=18)  and  Group  B  (N»17) .  Group  A  received  a  one-hour  pretest, 
two  hours  practice,  and  a  one-hour  posttest.  Group  B  received 
only  a  one-hour  pretest  and  a  one-hour  posttest.  Their  average 
total  flying  time  was  651  hours.  Because  of  conflicts  in 
trainee  entry  and  scheduling  of  training,  it  was  necessary  to 
randomly  assign  students  for  the  experimental  treatment. 

However,  as  a  group,  they  proved  to  be  homogeneous  in  terms  of 
aptitude  and  experience.  None  previously  had  received  specific 
training  in  the  communication  of  target  locations  between  forward 
air  controllers  and  strike  pilots.  Therefore,  differences  in  the 
performance  of  the  two  groups  on  the  criterion  test  may  be 
attributed  to  training  experience. 

EVALUATION  PERSONNEL 

Three  experiiaenters  conducted  the  test  as  follows :  (1)  one 
experimenter  operated  the  tactical  strike  pilot  position, 

(2)  one  experimenter  operated  the  trainer  instructor  position, 
and  (3)  one  experimenter  conducted  the  supervised  trainer 
practice  sessions.  Each  experimenter  retained  the  same  trainer 
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assignment  throughout  the  testing  period.  Bach  had  wide 
experience  in  conducting  Air  Force  training  and  testing 
programs . 

The  1st  Special  Operations  Wing,  Hurlburt  Field,  was  tasked 
by  Tactical  Air  Command  to  provide  monitorship  of  the  test 
program  and  student  scheduling  for  the  experiment.  Technical 
advice  was  provided  the  experimenters  by  combat  experienced 
FAC  and  strike  pilots  assigned  to  the  Tactical  Air  Command 
Air  Ground  Operations  School  at  Hurlburt  Field.  The  Air 
Ground  Operations  School  also  furnished  classroom  facilities 
for  the  testing  sessions. 


SECTION  IV 
PROCEDURE 


DESIGN 

The  criterion  test  consisted  of  2  sets  of  10  color  slides; 
one  set  of  10  slides  for  the  FAC  with  a  simulated  altitude  of 
2,000  feet  and  another  set  of  10  slides  for  the  TAG  taken  at 
8,000  feet.  The  same  number  of  slides  of  an  equal  order  of 
difficulty  were  used  for  the  pretest  and  practice  session. 

The  experimental  design  is  shown  in  Figure  9. 


Figure  9.  Experimental  Design 


PROGRAM  ADMINISTRATION 

The  testing  program  was  administered  during  scheduled 
class  periods.  The  program  consisted  of  3  phases:  (1)  pretest, 
(2)  supervised  practice  session,  and  (3)  posttest.  Group  B 
did  not  participate  in  the  supervised  practice  sessions.  Group  A 
and  Group  B  subjects  were  pretested  and  posttested  on  an 
individual  basis.  Two  Group  A  students  received  supervised 
practice  on  the  trainer  at  the  same  time.  Testing  procedures 
were  as  follows: 
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Pretest 

The  student  viewed  Film  Number  SPR  17-71,  "FAC/TAC 
Training  Simulator, '•color,  330  feet,  7  minutes.  This  film 
provided  background  on  the  development  and  use  of  the  FAC/ 

TAC  trainer.  The  instructor  played  a  briefing  tape  which 
consisted  of  test  instructions  (Appendix  A)  and  a  scenario 
of  target  location  commuiii cations  by  an  experienced  FAC  and 
strike  pilot. 

The  instructor  explained  how  to  operate  the  trainer.  He 
then  gave  the  student  a  3- inch  x  5 -inch  card  which  bore  the 
name  of  the  target  such  as  truck  convoy,  supply  dtunp,  or  gun 
position.  The  card  also  indicated  the  cardinal  direction 
toward  which  the  student  was  looking  (north,  south,  east,  or 
west).  The  TAC  also  was  given  a  card  which  only  indicated 
the  direction  toward  which  he  was  looking.  The  student  could 
mark  directions  on  the  screen  with  a  grease  pencil.  The 
instructor  used  a  pointer  to  indicate  to  the  student  the 
location  of  the  target.  Then,  the  student  was  instructed  to 
begin.  When  the  student  established  voice  contact  on  the 
intercom  with  the  experimenter  operating  the  strike  pilot (TAC) 
position,  the  instructor  activated  a  stop  watch.  The  in¬ 
structor  stopped  the  timing  as  soon  as  the  FAC  told  t>e  TAC 
to  "mark"  the  target  or  when  the  FAC  exceeded  the  4-miaute 
time  limit.  The  instructor  logged  the  time  elapsed  and  the 
score.  He  scored  the  time  as  follows: 

Time  in'  Seconds  Score 


0 

-  60 

4 

61 

-  120 

3 

121 

-  180 

2 

181 

-  240 

1 

*0ver  240  0 


•During  the  trainer  tryout  sessions,  it  was  determined  that 
most  FAC  subjects,  using  the  same  imagery  as  provided  in  the 
evaluation,  successfully  transferred  target  location  information 
to  the  TAC  in  4  minutes,  or  less,  for  each  target. 
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Accuracy  was  scored  by  means  of  a  plastic  overlay'  which 
had  a  scale  ranging  from  0  to  S  Imprinted  on  it  as  shown  in 
Figure  10.  The  ring  is  placed  on  the  actual  target  location 
on  the  TAG'S  screen.  If  the  TAC’s  target  location  mark  fell 
within  the  ”5''  circle,  the  FAC  student,  received  a  scox^  of  S'. 

If  it  was  within  the  "4**  circle,  a  score  of  4.  was  given,  etc. 

A  score  of  0  was  given  when  the  mark  ^ai  outside  the  ’*1"  ' 
circle.  The  student's  total  score  was  the  combined  time  and 
accuracy  score  for  the  10  targets.  The  total  possible iScOre 
was  90. 


After  completing  the  first  target  run',  the  student 
cleaned  the  grease  pencil  markings  from  the i screen  Clighter 
fluid  is  recommended  by  the  screen  manufacturer  for  this 
purpose) .  The  instructor  gave  him  a  new  card  bearing  the 
name  of  the  second  target  and  the  direction  toward  which  the 
student  was  looking.  The  test  was  terminated  when  the  FAC 
student  completed  the  10-target  schedule.  i 
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The  targets  used  were  imaginary  because  target  indentifi- 
cation  was  not  an  objective  o£  the  test.  The  instructor  in¬ 
dicated  to  the  FAC  student  the  presence  of  troop  movements, 
gun  emplacements,  truck  convoys,  sampans,  and  other  imaginary 
targets.  However,  the  location  of  the  target  was  realistic. 
For  example,  a  sai^an  was  on  a  stream,  a  moving  truck  convoy 
was  on  a  road  or  trail,  etc.  Several  targets  could  be  used 
for  each  slide  simply  by  changing  locations  and  renaming  the 
targets . 

Supervised  Practice  Session 

After  pretesting,  the  Group  A  students  performed  in 
pairs  for  2  hours  on  the  practice  trainer.  They  alternated 
roles,  as  FAC  for  1  hour  and  as  strike  pilot  for  1  hour.  The 
students  were  instructed  to  work  together  as  a  team.  This 
procedure  differs  from  that  used  in  the  pretest  and  posttest. 
During; those  test  periods,  the  FAC  had  tc  guide  the  TAG 
to  the  target  without  active  assistance  by  the  TAG, 

For  example,  the  TAG  confirmed  landmarks  or  other  information 
only  when  requested  to  do  so  by  the  FAC  student. 

The  students  worked  through  20  targets  during  the  2 -hour 
practice  session  which  included  10  targets  at  the  FAC  position 
and  10  targets  at  the  TAG  position.  For  example,  a  student 
operated  the  FAC  side  of  the  trainer  using  10  slides  and  10 
targets.  He  then  assumed  the  TAG  role  and  the  TAG  student 
operated  as  the  FAC.  The  same  slides  with  different  targets 
were  used.  The  students  changed  trainer  positions  when  they 
alternated  roles.  The  students  were  scored  for  their  perfor¬ 
mance  only  as  a  FAC.  The  targets  were  scored  in  the  same  way 
as  for  the  pretest  and  posttest.  Scoring  of  the  targets  pro¬ 
vided  structure  for  the  practice  sessions  as  well  as  knowledge 
of  results  for  the  students.  A  team  score  for  the  2  students 
during  each  practice  session  was  derived  as  follows: 


Student  (1)  Score  •*•  Student  (2)  Score  =  Team  Score 
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Posttest 


Both  Group  A  and  Group  B  students  were  post tested  on  the 
trainer.  The  posttest  procedures  were  the  same  as  for  the  pre¬ 
test  except  that  the  trainer  briefing  film  was  not  shown  again. 
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After  completing  the  posttest,  each  student  vas 
administered  a  questionnaire  adapted  from  Labbe  and  Stordahl 
(Reference  6) .  The  questionnaire  was  used  to  measure  the 
student's  general  attitude  toward  the  trainer  (Appendix  B) . 


Transfer  of  Training 


Because  the  trainer  evaluation  had  been  superimposed 
on  an  existing  stringent  schedule,  transfer  of  training  from 
the  trainer  to  aircraft  was  not  included  in  the  experimental 
design.  However,  prior  to  completion  of  the  evaluation, 
arrangements  were  made  by  the  1st  Special  Operations  Wing  to 
obtain  flight  instructor  appraisals  on  some  of  the  students. 

A  total  of  8  Group  A  and  8  Group  B  students  were  rated  by 
their  instructors . 
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SECTION  V 


RESULTS 


RATIO  GAIN  SCORES 

One  of  the  first  considerations  in  the  design  of  this 
experiment  was  to  determine  the  gain  in  proficiency  a  student 
might  achieve  through  practice  on  the  trainer.  Ratio  gain 
scores  were  calculated  for  each  subject  for  the  pretest  and 
posttest  (Appendix  C) .  The  ratio  gain  scores  were  obtained 
by  dividing  the  actual  g'in  by  the  possible  gain.  The  results 
can  be  used  for  comparison  purposes.  An  example  of  the 
computation  of  a  ratio  gain  score  when  the  maximum  possible 
score  equals  90,  is  shown  below: 


Pretest  score: 

20 

Posttest  score: 

60 

Actual  gain: 

40 

Possible  gain: 

70 

40 

-  0.57  (ratio 

gain  score) 

Table  I  shows  the  ratio  gain  scores  for  the  35  FAC  students 
who  participated  in  the  comparison  study.  Each  student  is 
identified  in  terms  of  (1)  his  group  (A  or  B) ,  (2)  his  ratio 
gain  score,  and  (3)  the  rank  of  his  ratio  gain  score  relative 
to  the  ratio  gain  scores  of  the  other  FAC  students. 

A  Mann-Whitney  U  test*  was  calculated  for  the  rank-order 
data  to  evaluate  the  difference  in  the  achievement  in  gain 
between  the  two  groups.  The  gain  of  Group  A  was  significantly 
greater  than  that  of  Group  B  (Mann-Whitney  U,  z  »  2.475,  proba¬ 
bility  was  greater  than  .05).  A  scatter  plot  of  the  ratio  gain 
scores  for  the  two  groups  is  shown  in  Figure  11. 


*  This  statistic  (Reference  7)  is  a  powerful  nonparametric  test 
because  of  its  relative  efficiency  in  rejecting  the  null  hypo¬ 
thesis  when  the  hypothesis  is  false.  The  null  hypothesis  tested 
by  the  Mann-Whitney  U  is  that  the  independently  drawn  groups 
are  samples  of  the  same  population. 
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Figure  11.  Scatter  Plot  of  the  Ratio  Gain  Scores 
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TARGET  TRIALS  ANALYSIS 


The  scores  for  each  trial  performed  by  Group  A  and 
Group  B  students  were  calculated  and  graphed.  The  pretest 
and  posttest  consisted  of  10  trials  each.  The  combined  scores 
for  the  practice  session  show  the  effect  of  the  2  additional 
hours  on  the  performance  of  Group  A  students. 

Figure  12  is  a  graphic  presentation  of  each  pretest  trial 
for  the  two  groups.  In  the  first  6  trials  of  all  tests,  the 
students  used  imagery  with  the  same  heading  (students  looking 
in  the  same  direction).  For  example,  north  for  FAC  and  north 
for  TAG.  On  Trials  7  through  10,  the  headings  were  changed  to 
north  for  FAC,  and  east  for  TAG,  etc.  Apparently,  this  change 
interfered  (at  least  temporarily)  with  the  students’  orientation 
which,  in  turn,  affected  their  performance  unfavorably.  The 
drop  in  performance  for  both  groups  during  Trial  ^  shown 
in  Figure  12. 

During  the  practice  session,  the  performance  of  Group  A 
on  Trial  7  was  still  adversely  affected  by  the  change  in 
cardinal  directions  (Figure  13).  On  the  posttest,  however, 

Group  A  seems  to  have  solved  the  problem  associated  with  the 
90®  to  180®  change  in  direction.  A  pronounced  dip  in  performance 
for  Group  A  does  not  appear  on  Trial  7  of  the  posttest  (Figures 
13  and  14) .  Performance  by  Group  B  on  Trial  7  dipped  sharply 
on  the  pretest  and  performance  by  this  group  was  only  slightly 
better  for  Trial  7  on  the  posttest.  Apparently,  the  extra 
practice  received  by  Group  A  was  especially  helpful  on  this 
problem  (Figure  14). 

TRAINER  EVALUATION  QUESTIONNAIRE 

The  Trainer  Evaluation  Questionnaire  (adapted  from  Labbe 
and  Stordahl,  Reference  6)  is  included  as  Appendix  B.  The 
first  8  items  on  the  11 -item  questionnaire  were  intended  to 
provide  an  indication  of  student  satisfaction  with  the  trainer. 
The  remaining  3  items  were  concerned  with  how  the  student  felt 
about  (1)  the  difficulty  of  the  training,  (2)  length  of  time 
spent  in  training,  and  (3)  how  much  of  the  same  training  was 
previously  received  by  the  student. 

A  large  majority  of  the  FAC  students  who  participated  in 
the  evaluation  enthusiastically  endorsed  the  use  of  the  trainer 
in  the  forward  air  controller  training  program.  Their  responses 
to  the  11  items  on  the  questionnaire  are  presented  as  Appendix 
D. 
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9 

8 
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Figure  12,  Graphic  Presentation  of  Each  Pretest 
Trial  for  the  Two  Groups 


Figure  13.  Graphic  Presentation  of  Each  Pretest, 
Practice,  and  Posttest  Trial  for  Group  A 


Students  responding  in  the  top  40%  of  the  scale  (favorable 
end)  were  given  a  score  of  1  and  those  responding  below  the 
top  40%  were  given  a  score  of  0,  A  total  ’’general  satisfaction” 
or  ’’favorable  attitude”  score  was  obtained  for  each  group  of 
students  from  the  first  8  items  of  the  11-item  scale.  The 
percentage  of  students  responding  in  the  top  40%  jf  the  scale 
was  as  follows:  (1)  Group  A,  80.6%  and  (2)  Group  B,  80.1%. 

Most  of  the  students  (27)  expressed  the  opinion  that  the 
training  content  was  not  difficult.  Although  the  testing 
varied  from  4  hours  for  Group  A  to  2  hours  for  Group  B,  10 
Group  A  and  9  Group  B  students  felt  that  the  time  spent  in 
the  training  was  adequate.  Additional  training  time  was 
felt  needed  by  8  Group  A  students  and  6  Group  B  students. 

A  total  of  32  students  responded  that  for  them  the  training 
content  was  almost  entirely  new  material,  or  that  it  only 
slightly  overlapped  with  other  training  received.  These 
students  responses  (items  9  through  11)  are  detailed  in 
Appendix  D. 

TRANSFER  OF  TRAINING 

As  indicated  in  Section  IV  of  this  report,  because  of  a 
tight  flying  training  schedule,  transfer  of  training  from  the 
trainer  to  the  aircraft  was  not  included  in  the  experimental 
design.  However,  later  it  became  possible  to  obtain  flight 
instructor  appraisals  on  some  of  the  students  (N=8  for  each 
group) . 

The  students  were  rated  on  how  well  they  could:  (1) 
estimate  distance,  (2)  select  good  initial  reference  points, 

(3)  communicate  clearly,  and  (4)  communicate  concisely.  In 
addition,  the  students  were  rated  on  how  well  they  retained 
their  composure  (relaxed,  not  nervous)  under  time -sharing 
conditions  in  flight. 

The  ratings  were  completed  by  the  students '  instructor 
pilots.  The  instructors  evaluated  the  students’  performance 
against  other  students  who  had  not  been  tested  on  the  trainer. 
The  maximum  possible  score  was  30.  The  mean  scores  for  Group 
A  and  Group  B  were  20.5  and  19.4  respectively.  The  difference 
between  the  means  was  not  significant  (Mann-Whitney  U,  z  = 

.488). 

Unfortunately,  the  tested  groups  did  not  provide  a 
sufficiently  wide  base  for  a  realistic  evaluation.  Also, 
the  highly  subjective  checklist  used  by  the  instructors 
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optimally  could  differentiate  only  between  gross  level ’  of 
performance.  However,  the  instructors  were  of  the  opinion 
that  the  FAC/TAC  trainer  provided  an  added  benefit  to  the 
overall  OV-IO  and  0-2  training  program. 


i 
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SECTION  VI 

SUMMARY  AND  CONCLUSIONS 


METHOD 

Field  research  seldom  attains  the  desired  controlled 
conditions  of  laboratory  experiments  and  this  effort  was 
no  exception.  For  example,  it  was  not  administratively 
feasible  to  obtain  the  training  records  of  the  FAC  students. 
Therefore,  it  was  not  possible  to  assign  precisely  matched 
pairs  to  treatment  groups.  For  this  reason,  the  two  groups 
(Group  A  and  Group  B)  were  randomly  assigned.  Subsequent 
analysis  indicated  that  no  significant  differences  existed 
between  the  two  groups  as  measured  by  performance  on  the 
pretest. 

TRAINER  EVALUATION  RESULTS 

The  results  of  the  FAC/TAC  trainer  evaluation  indicate 
that  the  trainer  can  be  used  to  teach  FACs  how  to  tell  TACs 
of  the  location  of  targets.  During  the  initial  tryout  and  the 
subsequent  field  evaluation,  it  became  apparent  that  some  of 
the  major  factors  affecting  the  task  were: 


®  judgments  of  distance 
®  judgments  of  direction 
®  amount  of  scene  structure 
®  observer's  cardinal  direction  orientation 
®  observer's  altitude 
®  generalizability  of  landmarks 
®  color  contrasts 

The  trainer  can  provide  practice  in  each  of  the  above 
factors  if  suitable  imagery  is  used.  These  factors  were 
included  as  task  elements  of  the  performance  trials  in  the 
trainer  evaluation. 

The  variations  in  performance  on  the  various  trials  may 
enable  the  instructor  to  determine  and  correct  student  errors 
in  performing  certain  task  elements  such  as  distance  esti¬ 
mation,  judgments  of  direction,  etc.  For  example,  the  low 
scores  obtained  by  Group  A  and  Group  B  students  on  Trial  7 
(Figure  12)  were  caused  by  a  90®  change  in  direction  (North 
for  the  FAC  and  East  for  the  TAC) .  On  previous  trials,  the 
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headings  were  identical  for  both  FAC  and  TAG  positions.  For 
Trials  7  through  10,  the  directions  were  changed  by  90*  and 
180*. 

STUDENT  ACCEPTANCE  OF  THE  TRAINER 

The  students  participating  in  the  trainer  evaluation  were 
administered  a  ques.  onnaire  in  an  attempt  to  assess  their 
attitude  toward  the  trainer.  The  value  of  opinion  data 
depends  largely  upon  the  number  and  qualifications  of  per¬ 
sonnel  giving  the  opinions.  Because  the  students  had  practiced 
in  the  trainer  from  2  to  4  hours,  it  v/as  presumed  that  they 
were  qualified  to  judge  whether  or  not  they  favored  the  use 
of  the  device  in  the  FAC  training  program. 

In  general,  the  students  enthusiastically  endorsed  the 
use  of  the  trainer  to  provide  skills  in  communicating  target 
locations  to  strike  pilots .  Of  the  35  students  responding  to 
the  questionnaire,  only  3  held  negative  attitudes  toward  the 
trainer. 
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CONCLUSIONS 


The  results  of  this  study  have  implications  for  training 
both  FACs  and  TACs  in  transfer  of  target  information  by  voice 
communications.  During  the  supervised  practice  session,  the 
students  operated  the  trainer  as  two-man  teams  by  alternating 
FAC/TAC  roles.  The  student"*  performance  scores  for  10  trials 
(practice),  as  presented  in  Figure  13,  shows  that  the  students 
could  effectively  transfer  target  location  information  while 
operating  the  trainer  as  teams. 

A  fev;  of  the  inexperienced  FAC  students  demonstrated  an 
unusual  ability  to  start  with  easily  seen,  gross  landmarks  and 
then  quickly  lead  the  TAC  listener  to  the  target.  They  acoom- 
plished  this  by  clearly  specifying  figure/ground  relationships 
in  the  visual  scene  with  a  minimum  number  of  statements.  This 
ability  on  the  part  of  some  experienced  FACs  also  was  observed 
during  a  tryout  of  the  trainer  (Reference  4).  A  detailed  analysis 
of  the  cues  and  procedures  used  by  outstanding  students  in  the 
trainer  may  reveal  certain  techniques  that  are  worthy  of  training. 

The  FAC/TAC  trainer  was  designed  to  be  used  as  a  part- 
task  trainer.  It  was  not  intended  to  provide  practice  for  all 
tasks  related  to  the  FAC/TAC  opesation.  The  trainer  proved  to 
be  an  effective  instructional  device  when  used  to  achieve  its 
stated  purpose.  It  was  not  designed  to  supplant  necessary  flight 
training  in  the  overall  FAC/TAC  mission.  It  car  be  used,  however, 
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to  increase  proficiency  in  transfer  of  target  location  information 
from  the  FAC  to  the  TAG  in  ground-based  training.  Logically,  it 
appears  to  be  possible  to  use  the  trainer  to  instruct  pilots  in 
other  facets  of  the  FAC/TAC  operation,  but  further  experimental 
data  is  needed  to  support  sucfi  use  of  the  device. 
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APPENDIX  A 
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TEST  INSTRUCTIONS 


The  purpose  of  this  eocperimerit  is  to  evaluate  the  . 
effectiveness  of  this,  simulator  in  training  forward  air 
controllers  to  accurately  transmit  target  locations  to  other 
personnel  in  the  least  possible  time,  Tou  will  be  given  a 
test  which  consists  of  10  different  target  locations. 

Describe  each  target  location  to. the  operator  in  the  compart¬ 
ment  to  your  right,  'fhe  instructor  will  provide  you  with  the  ' 
targets  1  at  a  time.  Approximately  50  minutes  will  be  re¬ 
quired  to  complete  the  test.  You  will  be  allowed  a  maximum 
of  4  minutes  per  target.  If  you  exceed  4  minut-^s  on  a  target, 
the  instructor  will  call  you  on  the  intercom  and  say  "cease 
communications".  He  then  will  give  you  the  next  target. 

The  procedures  you  should  use  are  as  follows : 

1.  The  instructor  will  call  you  on  the,  intercom  and 

tell  you  what  the  target  is;  for  example,  gun  position,  ^ 
truck,  etc.  He  will  then  mark  the  target  lodation,  fot 
you  on  the  screen. 

2.  When  the ’instructor  provides  you  with  a  target, 
immediately  call  the  other  operator  and  inform  him  that 
you  have  a  target'  for  him.  Your  call  sign  and  his  call 
sign  are  on  a  card  at  your  position.  When  he  answers, 
begin  verbally  leading  him  to  thO  target.  Answer' his  , 
requests  for  additional  information  or  confirmation  until 
he  says,  "I  have  ihe  target". 

'  •  j 

I 

3.  When  the  other  operator  says  that  he  has  the  target, 
the  instructor  will  record  the  elapsed  time.  Also  he 
will  score  the  accuracy  of  your  voice  communications  by 
measuring  with  an  overlay  how  near  the  other  operator 

was  able  to  approach  the  target  following  your  instructions 

4.  Remember  that  the  other  operator,  although  experienced 
on  the  trainer,  does  noti know  the  locations  of  the  targets 
beforehand.  Therefore,  you  must  lead. him  to  each  target 

in  the  shortest  possible  time.  ,You  may  use  any  outstanding 
features  to  lead  him  to  the  target, such  as  a  bend  in  a 
river,  highways,  houses,  power  stations,  compass  directions 
etc.  If  an  objiect  looks  like  a  doughnut ,: Christmas  tree, 
geometrical  shapes  such  as  triangles^,  circles ,,  squares , 
etc.,  you  may  use  these  analogies  if  you  think  they  will 
assist  you  in  transmitting  target  location  information. 
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S.  Your  score  will  depend  upon  the  nunber  oi  targets 
completed  in  the  allotted  time  and  by  how  near  the  other 
operator  strikes  the  target.  Therefore,  you  should  work 
as  rapidly  and  accurately  as  you  can. 

■  The  following  taped  scenario  will  give  you  some  idea 
of  how  communications  between  the  FAC  and  strike  pilot  may 
be  conducted.  However,  you  may  verbalize  target  locations  as 
you  wish.  Efficient  communication  is  your  primary  objective. 

(The  instructor  plays  the  taped  scenario.) 

‘  Do  you  have  any  questions? 

I 
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APPENDIX  B 


TRAINEE  EVALUATION  OF  TARGET 
LOCATIONS  COMMUNICATIONS  TRAINING 

DIRECTIONS 


You  have  just  completed  approximately  four  hours  of  target 
locations  communications  training  on  the  forward  air  controller 
trainer.  You  can  help  Tactical  Air  Command  evaluate  the  effecti¬ 
veness  of  the  trainer  by  answering  the  questions  in  this  book¬ 
let.  This  questionnaire  contains  some  questions  about  your 
reactions  to  this  training.  Please  read  the  questions  carefully 
and  answer  them  as  frankly  as  you  can. 

Read  each  item  carefully  and  select  the  response  that  best 
represents  your  feelings  about  the  training.  Then  record  your 
response  by  circling  the  letter  in  the  booklet  which  corresponds 
to  that  answer.  If  you  want  to  change  an  answer,  erase  your 
first  circle  completely.  Be  sure  to  read  all  responses  before 
making  your  choice. 

Please  print  your  last  name  and  initials  on  the  booklet. 
Place  the  booklet  in  the  envelope  which  has  been  provided  and 
seal  it.  The  answers  you  give  will  be  regarded  as  confidential 
by  the  evaluation  team  and  no  one  connected  with  the  school 
will  read  them. 


NAME 

HOURS 
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1.  How  beneficial  do  you  think  this  training  will  be  to  you 
as  a  FAC? 

A.  Very  beneficial 

B.  Helpful 

C.  Of  some  use 

D.  Little  gained  from  it 

E.  Benefits  gained  do  not  justify  its  existence 

2.  How  do  you  feel  about  taking  this  training? 

A.  It  was  a  waste  of  my  time 

B.  Sorry  I  took  it 

C.  Indifferent 

D.  Somewhat  glad  I  took  it 

E.  Very  glad  I  took  it 

3.  How  practical  was  the  training  for  you? 

A.  Not  practical 

B.  Should  be  more  practical 

C.  Undecided 

D.  Quite  useful 

E.  Very  practical 

4.  How  important  was  this  training  to  the  work  that  most  of 
the  trainees  will  do  in  their  next  assignment? 

A.  Very  important 

B.  Quite  important 

C.  Of  some  importance 

D.  Of  slight  importance 

E.  Of  no  importance 

5.  How  much  do  you  feel  you  have  learned  from  this  training? 

A.  A  great  deal 

B.  More  than  average 

C.  About  average 

D.  Very  little 

E.  Almost  nothing 
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6.  How  interesting  was  this  training? 

A.  Very  interesting 

B.  Quite  interesting 

C.  Mildly  interesting 

D.  Somewhat  boring 

E.  Very  monotonous 

7.  How  satisfied  have  you  been  with  this  training? 

A.  Highly  dissatisfied 

B.  Generally  dissatisfied 

C.  Somewhat  satisfied  -  somewhat  dissatisfied 

D.  Generally  satisfied 

E.  Highly  satisfied 

8.  How  do  you  feel  about  the  difficulty  of  the  content  of 
the  training? 

A.  Very  difficult 

B.  It  gave  me  some  trouble 

C.  Not  too  difficult  -  not  too  easy 

D.  Rather  easy  material 

E.  Much  too  simple 

9.  How  do  you  feel  about  the  length  of  time  spent  in  the 
training? 

A.  Much  too  long 

B.  Training  time  could  be  shortened 

C.  Present  length  is  just  about  right 

D.  Would  help  to  add  a  little  more  time 

E.  Should  have  much  more  instruction 

10.  How  much  of  the  training  content  have  you  had  in  other 
courses? 

A.  Entirely  a  repetition  of  other  courses 

B.  Largely  a  repetition  of  other  courses 

C.  Moderate  (about  half)  amount  of  repetition 

D.  Only  slight  overlap  with  other  courses 

E.  Almost  entirely  new  material 
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11.  How  do  you  feel  about  using  the  FAC  trainer  to  teach 
target  location  communications  in  FAC  training? 

A.  Such  training  is  not  needed 

B.  Of  little  value 

C.  Moderately  useful 

D.  Quite  useful 

E.  Very  valuable 
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APPENDIX  D 


Frequency  Distributions:  Trainee  Evaluation  of 
Target  Location  Communications  Training 


1 .  HOW  BENEFICIAL  DO  YOU  THINK  THIS  TRAINING  WILL  BE  TO  YOU 
AS  A  FAC  ? 


2.  HOW  DO  YOU  FEEL  ABOUT  TAKING  THIS  TRAINING  ? 


FREQUENCY 

A 

1 

0 

2 

8 

7 

N»li, 

B 

1 

3 

6 

7 

N-17 

TOTAL 

1 

1 

5 

14 

14 

N-35 

3.  HOW  PRACTICAL  WAS  THE  TRAINING  FOR  YOU  ? 


4.  HOW  IMPORTANT  HAS  THIS  TRAINING  TO  THE  WORK  THAT  MOST  OF  THE 
TRAINEES  WILL  DO  IN  THEIR  NEXT  ASSIGNMENT  ? 


3S 
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TOTAL 


A 

B 


0 

0 

0 


FREQUENCY 


m 

1 

9 

8 

N-18 

2 

1 

5 

9 

N-17 

2 

2 

14 

17 

N-35 

7.  HOW  SATISIFIED  HAVE  YOU  BEEN  WITH  THIS  TRAINING  ? 


n.  HOW  DO  YOU  FEEL  ABOUT  THE  DIFFICULTY  OF  THE  CONTENT  OF 
THE  TRAINING  ? 


40 


TOTAL 


2 


17 


11 


N=18 

N-17 
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